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Abstract 



We consider a stochastic control problem where the set of strict (clas- 
sical) controls is not necessarily convex, and the system is governed by 
a nonlinear backward stochastic differential equation. By introducing a 
^^ ' new approach, we establish necessary as well as sufficient conditions of 

^ I optimality for two models. The first concerns the relaxed controls, who 

t^ . are measure- valued processes. The second is a particular case of the first 

^^ ' and relates to strict control problems. 
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rS ' 1 Introduction 



We study a stochastic control problem where the system is governed by a non- 
linear backward stochastic differential equation (BSDE for short) of the type 

dyt = b{t,y];,z^,Vt)dt + z];dWt, 

where b is given maps, W — (Wt)j>Q is a standard Brownian motion, defined on 
a filtered probability space {^,T, i^t)t>o '^) ' satisfying the usual conditions. 
The control variable v = (vt), called strict (classical) control, is an Tt 
adapted process with values in some set U of M™. We denote by U the class of 
all strict controls. 



The criteria to be minimized, over the set lA, has the form 



J{v)=V. 







where g and h are given functions and (yj', z^) is the trajectory of the system 
controlled by v. 

A control u G W is called optimal if it satisfies 

JH=infJ(i;). 

Stochastic control problems for backward and forward-backward systems 
have been studied by many authors including Peng [27], Xu [31], El-Karoui 
et al [12,13], Wu [30], Dokuchaev and Zhou [9], Peng and Wu [28], Bahlah 
and Labed [2], Bahlah [5,6], Shi and Wu [29], Ji and Zhou [19]. The dynamic 
programming approach was studied by Fuhrman and Tessitore [16] . 

Since the strict control domain being nonconvex, then if we use the classical 
method of spike variation on strict controls, the major difficulty in doing this is 
that the generator b and the running cost coefficient h depend on two variables 
yt and Zt- Then, we can't derive directly the variational inequality, because Zt 
is hard to handle, there is no convenient pointwise (in t) estimation for it, as 
opposed to the first variable yt- To overcome this difficulty, we introduce a new 
approach which consist to use a bigger new class TZ of processes by replacing the 
[/-valued process (vt) by a P(C/)-valued process (gt), where P (C/) is the space 
of probability measures on U equipped with the topology of stable convergence. 
This new class of processes is called relaxed controls and have a richer structure 
of compacity and convexity. This property of convexity of relaxed controls, 
enables us to treat the problem with the way of convex perturbation on relaxed 
controls. 

In the relaxed model, the system is governed by the BSDE 

dVt ^ lu^ (^' y?' ^ti a) qt (da) dt + z^dWt, 

The functional cost to be minimized, over the class TZ of relaxed controls, is 
defined by 



J (g) = E 



9{vl) 



h{t,yt,z1,a)qt{da)dt 



A relaxed control ^ is called optimal if it solves 

J(m)= ini J{q). 

qeTl 

The relaxed control problem is a generalization of the problem of strict 
controls. Indeed, if qt (da) ~ 6y^ (da) is a Dirac measure concentrated at a 



single point Vt € U, then wc get a strict control problem as a particular case of 
the relaxed one. 

Our aim in this paper, is to establish necessary as well as sufficient con- 
ditions of optimality in the form of global stochastic maximum principle, for 
both relaxed and strict controls. To achieve this goal, we derive these results as 
follows. 

Firstly, we give the optimality conditions for relaxed controls. The idea is 
to use the fact that the set of relaxed controls is convex. Then, we establish 
necessary optimality conditions by using the classical way of the convex pertur- 
bation method. More precisely, if we denote by /x an optimal relaxed control 
and q is an arbitrary element of TZ, then with a sufficiently small 6 > and for 
each t € [0,r], we can define a perturbed control as follows 

f^t ^ ^^t + [qt - Mt) • 

We derive the variational equation from the state equation, and the varia- 
tional inequality from the inequality 

0< J(/)-J(m). 

By using the fact that the coefficients b and h are linear with respect to the 
relaxed control variable, necessary optimality conditions are obtained directly 
in the global form. 

To achieve this part of the paper, we prove under minimal additional hy- 
pothesis, that these necessary optimality conditions for relaxed controls are also 
sufficient. 

The second main result in the paper characterizes the optimality for strict 
control processes. It is directly derived from the above result by restrict- 
ing from relaxed to strict controls. The idea is to replace the relaxed con- 
trols by a Dirac measures charging a strict controls. Thus, we reduce the set 
TZ of relaxed controls and we minimize the cost J over the subset 5 iU) = 
{q E TZ I q ~ 5v ; v G U}. Necessary optimality conditions for strict con- 
trols are then obtained directly from those of relaxed one. Finally, we prove 
that these necessary conditions becomes sufficient, without imposing neither 
the convexity of U nor that of the Hamiltonian H in v. 

The paper is organized as follows. In Section 2, we formulate the strict and 
relaxed control problems and give the various assumptions used throughout 
the paper. Section 3 is devoted to study the relaxed control problems and 
we establish necessary as well as sufficient conditions of optimality for relaxed 
controls. In the last section, we derive directly from the results of Section 3, the 
optimality conditions for strict controls. 

Along this paper, we denote by C some positive constant and we need the 
following matrix notations. We denote by M.ny.d (K) the space oi n x d real 
matrices and by Mnxn (I^) the linear space of vectors M = (Mi, ..., Md) where 

Mi^Mnxni^)- 



For any M, TV € A^^x„(R), L,S E Mnxdi^), Q G A^«x„(K), «,/? S 
and 7 G M'', wc use the following notations 

n 

a/3 = \Jcti/3i G K is the product scalar in M"; 

1=1 

d 

LS* = yjii5i e K, where L^ and Si are the i*'' columns of L and S'; 

i=l 

d 
ML = ^M,U e R"; 



i=l 

Ma7 = Y. (Mra) 7^ G 
1=1 

d 



MN = Y^M.N, e A^„x„ ( 

i=l 



n X n V-^^y I 
= 1 



MQi = ^M,Q7, e A^„x„ (M). 

i=l 

We denote by L* the transpose of the matrix L and M* = (Mj*, ..., MJ). 

2 Formulation of the problem 



Let I il,^, i^t)t>o '^) be a filtered probability space satisfying the usual con- 
ditions, on which a d-dimensional Brownian motion W — (^i)t>o i^ defined. 
We assume that (jFj) is the P- augmentation of the natural filtration of W. 
Let T be a strictly positive real number and U a subset of M™. 

2.1 The strict control problem 

Definition 1 An admissible strict control is an Tt— adapted process v — (vt) 
with values in U such that 



E 



sup \vt\ 
a<t<T 



< 00. 



We denote by U the set of all admissible strict controls. 
For any v Ehi, we consider the following controlled BSDE 

" dy-, = h (t, y,", z,^ Vt) dt + z-^dWu ,^ . 

where b : [0,T] x R" x Mnxd (R) x U — > R" and ^ is an n-dimcnsional Tt- 
measurable random variable such that 

E|^|^ < 00. 



The criteria to be minimized is defined from U into K by 

J(i;) = E 



9{yl)+ I hit,ylz]:,vt)dt 





(2) 



where, 



5 : K" — > K, 

h: [0,r] xM" xMnxdW X C^ 

A strict control u is called optimal if it satisfies 



J (u) = mi J (v) . (3) 



We assume that 



b, g and ft, are continuously differentiablc with respect to (y, z) . (4) 

They and all their derivatives with respect to (y, z) are continuous in (y, z, w) . 
They are bounded byC (l + |y| + |z| + |f|) and their derivatives 
with respect to (y, z) are continuous and uniformly bounded. 

Under the above hypothesis, for every v ^ U , equation (1) has a unique 
strong solution and the functional cost J is well defined from U into R. 

2.2 The relaxed model 

The idea for relaxed the strict control problem defined above is to embed the 
set U of strict controls into a wider class which gives a more suitable topological 
structure. In the relaxed model, the [/-valued process v is replaced by a P {U)- 
valued process q, where P ([/) denotes the space of probability measure on U 
equipped with the topology of stable convergence. 

Definition 2 A relaxed control {qt)t *s a ¥ (U)-valued process, progressively 
measurable with respect to {J^t)t '^'^^ such that for each t, l]o.t]-9 is Tt-measurable. 
We denote by TZ the set of all relaxed controls. 

Remark 3 The set of strict controls is embedded into the set of relaxed controls 
by the mapping 

f : v\ — >fy {dt, da) ~ dtS.^ (da), 

where Sy is the atomic measure concentrated at a single point v. 

For more details on relaxed controls, see [1] , [3] , [4] , [5] , [10] , [14] , [21] , [23] , [24] . 

For any q <E TZ, wc consider the following relaxed BSDE 

^Vt = /t/ ^ (*' Vt ' ^t : a) qt (da) dt + z^dlVt , ,^. 



The expected cost to be minimized, in the relaxed model, is defined from TZ 
into M by 



J (g) = E 



9{yl) 



h{t,y1,z1,a)qt {da) dt 



'0 Ju 
A relaxed control fi is called optimal if it solves 



J{^l)= inf J(g). 

q&TZ 



(6) 



(7) 



Remark 4 // we put 

h{t,y!,zf,qt) 
Then, equation (5) becomes 



b{t,yt,z1,a)qt{da) 



h{t,y1,z1,a)qt{da) 



dyl ^b{t,ylzlqt)dt + zUWt, 
With a functional cost given by 



(50 



J{q)=E 



givl) 



h{t,yt,z^,qt)dt 



Hence, by introducing relaxed controls, we have replaced U by a larger space 
F{U). We have gained the advantage that P([/) is both compact and convex. 
Furtherm,ore, the new coefficients of equation (5') and the running cost are linear 
with respect to the relaxed control variable. 

Remark 5 The coefficient b (defined in the above remark) check respectively the 
same assumptions as b. Then, under assumptions (4), b is uniformly Lipschitz 
and with linear growth. Then by classical results on BSDEs, for every q ^ TZ 
equation (5') admits a unique strong solution. Consequently, for every q (z TZ 
equation (5) has a unique strong solution. 

On the other hand. It is easy to see that h checks the same assumptions as 
h. Then, the functional cost J is well defined from TZ into K. 

Remark Q If qt — dy^ is an atomic measure concentrated at a single point 
Vt € U, then for each t G [0, T] we have 



bit,yt,z1,a)qtida) = / b{t,y^, z^ ,a) Sy^ (da) ^ b{t,y^, z^ ,vt) , 
u Ju 



h (t, yh 4i a) qt (da) ^ h{t, y1, z^ , a) Sy^ (da) = h (t, y1, zf, Vt) . 
u Ju 

In this case (y^,z'') — {y'",z^), J (q) = J (v) and we get a strict control 
problem. So the problem of strict controls {(1) , (2) , (3)} is a particular case of 
relaxed control problem {(5) , (6) , (7)}. 



3 Necessary and sufficient optimality conditions 
for relaxed controls 

In this section, we study the problem {(5) , (6) , (7)} and we estabhsh necessary 
as well as sufficient conditions of optimality for relaxed controls. 



3.1 Preliminary results 

Since the set TZ is convex, then the classical way to derive necessary optimality 
conditions for relaxed controls is to use the convex perturbation method. More 
precisely, let /x be an optimal relaxed control and (j/f,zf) the solution of (5) 
controlled by /x. Then, we can define a perturbed relaxed control as follows 



lA = A*t +0{qt - Ht)' 



(8) 



where, 9 > is sufficiently small and q is an arbitrary element of TZ. 

Denote by (yf, zf) the solution of (5) associated with ji^ . 

From optimality of /i, the variational inequality will be derived from the fact 
that 

0< J(/)-J(a^). 

For this end, we need the following classical lemmas. 



Lemma 7 Under assumptions (A), we have 



lim 



sup E 2/t -yf 

0<t<T 



= 0, 



limE 



\Zf ~ z. 



ridi^o. 



(9) 



(10) 
(11) 



Proof. Applying Ito's formula to (j/f — y'f\ , we have 
E\y',-y>^f+Ef \z'^ - z^f ds 



2E 



{y! y^) 



b (s, yf , zf , a) /xf {da) - b{s, y^ , z^ , a) ^, {da) 
u Ju 



ds. 



From the Young formula, for every e > 0, we have 

ds 



E 


yt- 


yr 


2 

+ 


H 





< 


Ie 

e ^ 


r 


y'. 


-V's 


ds 



b (s, yl zl a) ^il {da) - b{s, y^, z^, a) /z. {da) 
u Ju 



ds. 



Then, 



Ely^-y^f+El \z! - z^\' ds 



<-Ef \yt-yi:\'ds 
t Jt 



+ CeE 



+ CeE 



■CeE 



b (s, yt, zl, a) ^f {da) - / fe (s, yf , zf , a) ^s {da) 
Ju 

b {s, yl, zl, a) ^s {da) - b{s, j/^, zf , a) fi^ {da) 



b {s, y^, zl, a) ^is {da) - b{s, y^, z^, a) fis {da) 
u Ju 



ds 

2 

ds 
ds. 



By the definition of /i^, we have 



Elyf-yfl'+E/' \zt-z^\^ds 



<-e[ \yl~y':fds 



CeO^E 



■Cel 



■CeE 



b (s, y^ , z^ , a) q^ {da) - / b{s,y^,z^, a) ^^ {da) 



ds 



b (s, yt^ zl,a) fis {da) - b{s, y'i,zl, a) Hs {da) 



b (s, y'^, zf , a) Us {da) - b{s, y^, z^, a) ^^ {da) 
u Ju 



ds 



ds. 



Since b is uniformly Lipschitz with respect to y, z, then 



E yt - yf + E / z: -zi! ds < [ -+C e E y^ - y^ ds 



1 



e 



■CeE I K-zn ds + CeO^ 



Choose e = — -^, then we have 



E|yf-yf|' + iEy|' |zf - z,^|' ds < (^2C + i) E^^' |yf - y,^f ds + Ce^^ 



From the above inequahty, we derive two inequahties 

E \yl - yff < (2c + i^ E^ \yl - y,^f ds + Cee\ 



(12) 



|zf-z,^| rfs< (4C+1)e/ |yf-y^| rfs + 2Ce6'2. (13) 

It Jt 

By using (12), Gronwall's leniina and Bukholdcr-Davis-Gundy inequality, we 

obtain (10). Finally, (11) is derived from (10) and (13). ■ 

Lemma 8 Let yt be the solution of the following linear equation (called varia- 
tional equation) 



dyt^ / [by{t,yt,Zt^a)yt+bz{t,yt,z^,a)zt]nt{da)dt 

b{t,yt,Zt^a)qt{da)- I b{t,y'^ , z^,a) fit (da) 
^ u Ju 

I Vt = 0. 

Then, the following estimations hold 



dt + ZtdWt, 
(14) 



limE 

0^0 



8 M 

Vt - Vt 



limE 



Proof. For simplicity, we put 



zi - z: 



-0, 



Zt 



dt^O. 



Y, 



_yt - Vt 



8 M 

Zt - zr 



Vt, 



Zt - —Q Zt. 

Kl (a) = (i, y'i + \9 (vf + yt) , zf + XO (zf + zt) , a) . 
By (17) and (18) we have the following BSDE 

dYf = {pyYfdt + pyzf 7^ dt + ZfdWt, 
YS = 0, 



where, 



Fi'^ 



Ft'-^- 



JU 

1 



JU 



by (A^ (a)) fit (da) dX, 
b, (A^ (a)) fit (da) dX, 



and 7( is given by 



(15) 

(16) 

(17) 
(18) 
(19) 



It 



t Ju 



[by {At (a)) {yt - yf^) + b. {At (a)) {zt - z^)] g. (da) ds 



t Ju 



[by {At {a}) {jjt y^) + b, {At (a)) {zt z^)] fi, {da) ds. 



Since by and bz are bounded, then 



By (10) and (11), we get 

liniEkfl^ = 0. (20) 

Applying Ito's formula to (Yf) , we get 



E\Yff+Ef IZirds 



By using the Young formula, for every e > 0, we have 



|y/f+E/" \z'^\'ds<E\YS\' + -Ef |r/frfs + eE/" | (FJ'F/ + F,"Zf - 7f ) f ds 



1 r r 

<E|r^P + -E/ \Y^\^ds + CeE iF^'K^l^ds 

+ CeEf |F/Zff ds + CeE/ |7ffds. 



Since i^jf and F/ arc bounded, then 



E|y/f+E/" |zff rfs< (i + CejE/ |y/fds+C£E/" \z'^^\^ ds+C eE f |7ffds, 

Choose e = — — , then we have 

E\Yff + ^Ef |zf|^ds< (2C+ijE/" \Y^^fds + C eEJ" \-ftf ds. 
From the above inequality, we deduce two inequalities 

E\Yf\^ <f2C+^^Ef |y/fds + CeE/" \jt\^ ds, (21) 

/T /"^ 9 /"-^ 9 

|zf| ds<{4C + l)E |r/| ds + 2CeE \j'^,\ ds. (22) 

By using (20) , (21) and Gronwall's lemma, we obtain (15). Finally (16) is 
derived from (15) , (20) and (21). ■ 



10 



Lemma 9 Let jj, he an optimal control minimizing the functional J over TZ and 
(j/^, zf ) the solution of (5) associated with ii. Then for any q € TZ, we have 



0<E[gy{y^)y„ 
+ E 



(23) 



dt 



h{t,yt,z^,a)qt{da) - / h{t,y^ , zl^ ,a) Ht (da) 
u Ju 

hy {t, y'^, Zj^, a) fit (da) ytdt + E hz{t, yf , zf , a) fit (da) Ztdt. 

Ju Jo Ju 

Proof. Let /i be an optimal relaxed control minimizing the cost J over TZ, then 
from (9) we have 



0<E[g{y'o)-9iyi;)] 



-E 



T r 



h (i> Vt^ 4-. «) Mt {da) - h{t, y'^, z'^ , a) fit (da) 



E[g{y'o)-9{yi;)] 



h {t, Vt, 4, a) Mt {da) - / h{t,yt,Zt, a) fit {da) 



h {t, yf, zf, a) fit {da) - h{t, y'^ , z^, a) fit {da) 
u Ju 



dt 

dt 
dt. 



From the definition of /i", we get 
0<E[g{y'„)-g{y^)] 



JU 



h (i, Vt^^t, a) It {da) - / h{t,yt,Zt, a) fit {da) 
JU 

[h (t, 2/f , z^, a) -h {t, y'^, zf , a)] fit (da) dt. 



dt 



Then, 



< E / [gy {yi; + Xe {yo + Y,')) yo] dX 





E / / [ [hy (A? (a)) yt + h, (A^ (a)) It] Mt {da) dXdt 
Jo Jo Ju 



E 



h{t,yt,4^"-)<lt{da) - / h{t,y^,z^,a)fit{da) 
u Ju 



(24) 



dt + pl 



11 



where p^^ is given by 

p^ = E / [gy (y(; + \e (yo + Y^)) Y^] dX 

[hy (A« (a)) {yt ~ y^) + h. (A^ (a)) (zf - zf )] ^i, (da) dXdt 







JO Ju 

f f [hy (Af (a)) r/ + /i, (A? (a)) Zf ] Mt (rfa) dXdt. 

Jo J(7 

Since the derivatives gy,hy,hz are bounded, then by using the Cauchy- 
Schwartz inequality, we have 



/ 9x1/2 f fT ^ V^ f F 

pt^UYy)+U y',-y^'dt] + e/ -4- 
^ ^ y Jo y Y Jo 


X 1/2 

- z't ' dt 
j 


/ .T , V" f r^ , V'^ 


/ 


+ E / Yy dt + E / Zf di 




V Jo / \ h j 




By (10) , (11) , (15) and (16), we get 




hmp^ = 0. 
e^o 





Finally, by letting 6* go to in (24), the proof is completed. ■ 

3.2 Necessary optimality conditions for relaxed controls 

Starting from the variational inequality (23), we can now state necessary opti- 
mality conditions for the relaxed control problem {(5) , (6) , (7)} in the global 
form. 

Theorem 10 (Necessary optimality conditions for relaxed controls) Let fj, be 
an optimal relaxed control minimizing the functional J over TZ and (t/f,zf) 
the solution of (5) associated with p. Then, there an unique adapted process p^, 
which is the solution of the forward stochastic equation (called adjoint equation), 



-dpt = y-y (t, Vt, Zt^ l^t,Pt) dt + Hz {t, yt, zf , Pt.Pt) dWt 
Po = 3a (2/0 



M - „ (.,i^\ (25) 



such that 

H{t,y^,z^,pt,p'^)>n{t,y^,z^,qt,p'^), Vg, eP(t/), ae ,as. (26) 

where the Hamiltonian U is defined from [0, T] x R" x Mnxd (M) x M" x P ([/) 
into M hy 

'H{t,y,z,p,q) ==p b{t,y,z,a)qt{da)- / h{t,y,z,a) qt (da) . 
Ju Ju 



12 



Proof. Since p^ = gyivo), then (23) becomes 

< E [p^y„] +e[ [ [hy (t, y^ zf , a) yt + K (i, yf , ^f , a) Zt] fit (da) dt (27) 
Jo Ju 

i-T 

I h{t,y^,zl^,a)qt{da) - I h{t,y'^ , z^ ,a) ^t (da) 
'u Ju 



E 



dt. 



By applying Ito's formula to (p'^yt), we have 
EKyo] = 



hy (t, yt, zf , a) lit (da) yt + h^ {t, yf , zf , a) fit (da) Zt 
Ju Ju 



dt 



+ e/ pf 



& {t, Vti Zt, a) A^t {da) - b{t, y'^, zf , a) qt {da) 
u Ju 



dt 



Then for every q ^ TZ, (27) becomes 



< E / [n{t, yf , zf , iit,P^) - H {t, yf , z^ gt,^^] c^^- 



(28) 



The theorem is proved. 



3.3 Sufficient optimality conditions for relaxed controls 

In this subsection, we study when necessary optimality conditions (26) becomes 
sufficient. We recall assumptions (4) and the adjoints equation (25). For any 
q E TZ, we denote by (y'', z'') the solution of equation (5) controlled by q. 

Theorem 11 (Sufficient optimality conditions for relaxed controls). Assume that 
g and the function {y,z) i — > Ti. {t,y, z,q,p) is concave. Then, ji is an optimal 
solution of the relaxed control problem {(5) , (6) , (7)}, if it satisfies (26) . 

Proof. Let fi be an arbitrary element of TZ (candidate to be optimal) . For any 
q G TZ, we have 



J{q)-J{fi)^E[g{yl)-g{yi;)] 

t-T 



E 



h {t, y1, z1, a) qt {da) - h{t, yf , zf , a) fit {da) 
u Ju 



dt. 



Since g is convex, then 

g {Vo) - 9 {Vo) > 9y {Vo) {Vo - Vo) 
Thus, 



j{q)-j{f,)>ngy{y^^){vl-v^o)] 



E 



h{t,yt,z1,a)qt{da)- I h {t , yi^ , z^ , a) fit {da) 
u Ju 



dt. 
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We remark from (25) that 



Then, we have 



Po = 9v (j/o ) ■ 



j(q)-j{ii)>nPoiyl-y^)]+^ 



h {t, Vt, z1, a) qt (da) ~ h{t, y'^ , zf , a) ^it (da) 
u Ju 



dt. 



By applying Ito's formula to p^ (y^ — y^), we obtain 



Jo 



+ E p^ 

'0 



b{t,yt,Zt,a)fit{da)- / b{t,y^,z^,a)qt{da) 
Uu Ju 



dt 



Then, 



J(g)-J(M) (29) 

>e/ [H{t,y^;,z^,tiuP^)-n{t,ylzlqt,p^)]dt 
Jo 

+ ¥.[ Hy (i, yf , zf , Mt, Pf) (y? - yO dt 
Jo 

+ Ef n, (i, y^ zf , ^lt,p'^) {zt - ;^r) dt. 

Jo 

Since Ti is concave in {y, z) and linear in /i, then by using the Clarke gener- 
alized gradient of Ti evaluated at {yt,zt,iJ.t) and the necessary optimality con- 
ditions (26), it follows by [33, Lemmas 2.2 and 2.3] that 

w (t, Vt, z^, fit,Pt) - U {t, yh 4, <it,Pt) > -Uy (i, 2/4^, zf , ^it■,p'i) (yt - vt) 

- Uz {t, yf , zf , fit,Pt) {z! - 2;f ) 

Or equivalently, 

< H (t, yf , zf , ^lt,Pt) - T-i {t, yh z1, qt,pt) + Uy {t, yf , zf , Mt,?^ (y? - Vt) 
+ Uy. {t, yf , zf , Mt,Pn (^t' - ^n 



Then from (29), we get 



The theorem is proved. 



J{q)-J{fl)>0. 
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4 Necessary and sufficient optimality conditions 
for strict controls 

In this section, we study the strict control problem {(1) , (2) , (3)} and from the 
results of section 3, we derive the optimality conditions for strict controls. 

Throughout this section we suppose moreover that 

U is compact. (30) 

b and h are bounded. 
Consider the following subset of TZ 

5{U) = {qen I q = S^ ; v e U} . (31) 

The set S {U) is the collection of all relaxed controls in the form of Dirac 
measure charging a strict control. 

Denote by 5 (U) the action set of all relaxed controls in S {U). 

If 9 S 5{U), then q — 6y with v ^ hi. In this case we have for each t, 
qt & S (U) and qt = &vt ■ 

We equipped P ([/) with the topology of stable convergence. Since U is 
compact, then with this topology P (U) is a compact metrizable space. The 
stable convergence is required for bounded measurable functions / (i, a) such 
that for each fixed t € [0,T], f (t, .) is continuous (Instead of functions bounded 
and continuous with respect to the pair (i, a) for the weak topology). The space 
P (U) is equipped with its Borcl cr-field, which is the smallest cr-field such that the 

mapping q i — > / / (s, a) q {ds, da) are measurable for any bounded measurable 

function /, continuous with respect to a. For more details, see Jacod and Memin 
[29] and El Karoui et al [16]. 

This allows us to summarize some of lemmas that we will be used in the 
sequel. 

Lemma 12 (Chattering Lemma). Let q be a predictable process with values in 
the space of probability measures on U . Then there exists a sequence of pre- 
dictable processes (u")^ with values in U such that 

dtq^ (da) = dt5u" {da) — > dtqt (da) stably, V — a.s. (32) 

where Su'^ is the Dirac measure concentrated at a single point m" of U . 

Proof. See El karoui et al [14] . ■ 

Lemma 13 Let q be a relaxed control and (u")„ be a sequence of strict controls 
such that holds. Then for any function / : [0,T] x t/ — > R, m,easurable in t 
and continuous in a, we have 

f {t, a) dur^ (da) — > / / {t, a) qt {da) ; dt - a.e (33) 
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Proof. By (29) and the definition of the stable convergence (See Jacod-Memin 
[21]), for any bounded function / (i, a) measurable in t and continuous in a, we 
have 

/ f f{t,a)6u^{da) -^ f f f{t,a)qtida). 

Jo Ju n^oo 7q Jjj 

Put 

g{s,a) == l[o,ti (s)/(s,a). 

It's clear that 



Ju 



9 {s, a) (5„y (da) 



Ju 



9 {s, a) Qs (da) . 



Then 

nf (s, a) 5u^ (da) > / f{s,a) Qs (da) . 

The set {(s,t) ; < s <t <T} generate B[o,t]- Then VB G B[o,t], we have 



/ (s, a) Su'- (da) 



ibJu 
This implies that 



/ (s, a) Qs (da) 



bJu 



f (s, a) Su^ (da) 



n >oo 



/ (s, a) Qs (da) , dt — a.e. 



The lemma is proved. 



The next lemma gives the stability of the controlled FBSDE with respect to 
the control variable. 

Lemma 14 Let q E TZ be a relaxed control and {y'^^z'') the corresponding tra- 
jectory. Then there exists a sequence (w")^ C U such that 



limE 

n— ^oo 



sup \y'^-y'l\^ 

te[o,T] 



limE/ |zj"-z-'|^di = 0, 



lim J(m") = J(9). 

n — >oo 

where (y", z") denotes the solution of equation (1) associated with u" 
Proof, i) Proof of (33) and (34). 



(34) 

(35) 
(36) 
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We have 



L Vt-Vt 



b{t,ylzlu^)^bit,ylzlu^)]dt 
bit,yt,4,i^t)~ / b{t,y1,z1,a)qt{da) 



+ {z^~z1)dWu 
0. 



dt 



Put 



Y, 



n ^,n 



Vt -vh 



yn _ n _ q 



and 



^" (i, y,", ZD = b it, yl zl u^)- b it, yl zl a) qt ida) 

Ju 

+ fby (t, yl + A (yr - vt) ,zt + \ (zf - z«) , <) i;"dA 
+ / 6, (t, y,« + A (2/r - 2/?) , 4 + A (^t" " 4) , <) Z^dX. 



(37) 



Then 



dYl" ^ (^" it, Yl", Z-^) dt + Z-^dWt, 
Y^ ^0. 



(38) 



The above equation is a hnear BSDE with bounded coefficients and with 
terminal condition Yf' = 0. Then by applying a priori estimates (see Briand et 
al [8, Proposition 3.2, Page 7]), we get 



E 



E 



te[o,T] 
From (36), we get 

t6[0,T] 



sup |r/f + / iZ^'fdt <CE f 

E[0,T] Jo Jo 



\^^it,0,0)\dt 



sup |i;"|V / \Z"\^dt <CE I 
E[0,T1 Jo Jo 



bit,y1,zt,u")~ I bit,yl,z'l,a)qt{da) 
u 



dt 



Since b is continuous and bounded, then from (32) and the dominated con- 
vergence theorem, the term in the right hand side tends to zero as n tends to 
infinity. This prove (33) and (34). 

ii) Proof of (35) . 
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Since g and h are uniformly Lipshitz with respect to {y,z), then by using 
the Cauchy-Schwartz incquahty, we have 



\j{qn-jm 



<C E 



(^\yo-y'o\ 



1/2 



c 



\ 1/2 

E\y^^y^,fds] +C 



1/2 



+ C E 



h{t,yt,z^,u^)dt~ / / h{t,y^,z^,a)qt{da)dt 
Jo Ju 



\z^^z?\Ut 



1/2 



From (33) and (34) the first three terms in the right hand side converge to 
zero. Furthermore, since h is continuous and bounded, then from (32) and by 
using the dominated convergence theorem, the fourth term in the right hand 
side tends to zero. This prove (35). ■ 

Lemma 15 As a consequence o/(35), the strict and the relaxed control problems 
have the same value functions. That is 



inf J (v) = inf J (q) 



(39) 



Proof. Let u E U and /i G 7?. be respectively a strict and relaxed controls such 
that 



J{fi}= miJiq). 
qeiZ 

J (u) = inf J (v) , 

veu 

By (39), we have 

J{fl)<J{q),yqeTZ. 

Since 5 (U) C 7^, then 

J{^i)<J{q),yqe5{U). 
Since q E 5 (U), then q = S^, where v <eU. It follows 



(40) 
(41) 



(2/'?,z9) = (y^z-) 
Jiq)^Jiv). 



Hence, 



Jifi) <J (v) ,yveU. 
The control u becomes an element of U, then we get 

J{p)<J (u) . 

On the other hand, by (40) we have 

J{u)<J {v) ,'iveU. 



(42) 
(43) 
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The control /i becomes a relaxed control, then by lemma 12, there exists a 
sequence (w")„ of strict controls such that 

dt/i" (da) = dtSyn (da) — > dtfit (da) stably, V — a.s. 

By (42), we get then 

J{u) < J(w"), VneN, 
By using (35) and letting n go to infinity in the above inequality, we get 

J{u)<J{fi). (44) 

Finally, by (41) and (43), we have 

J{u)^J{fi). 
The lemma is proved. ■ 

To establish necessary optimality conditions for strict controls, we need the 
following lemma 



Lemma 16 The strict control u minimizes J over hi if and only if the relaxed 
control fi ~ Su minimizes J over TZ. 

Proof. Suppose that u minimizes the cost J over U, then 

J {u) = iniJ (v) . 



By (38), we get 
Since fi — Su, then 

This implies that 



J (u) ^ inf J (q) . 

qeTZ 



(y^z^) = (2;^z«), 
J{^)^ J {u) , 



J{ii)=miJ{q). 
qeiz 



(45) 



Conversely, ii n = 6u minimize J over TZ, then 

Ji^i)=miJiq). 
qeiz 

By (38), we get 

J(m) = inf J(i;). 
veu 
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And By (44), wc obtain 



The proof is completed. 



J{u) =MJ{v). 



The foUowing lemma, who will be used to establish sufficient optimality 
conditions for strict controls, shows that we get the results of the above lemma 
if we replace TZ by S (U) . 

Lemma 17 The strict control u minimizes J over hi if and only if the relaxed 
control fi = Su minimizes J over d (U) . 

Proof. Let fi ~ 6u he an optimal relaxed control minimizing the cost J over 
5 (U), we have then 

J{l^)<J{q), yqeS{U). 

Since q G S {U) , then there exists v Cz U such that q = Sy. 
It is easy to see that 



{y^,z^) = {y\z-), 
J (p) = J{u), 
J{q) = J{v). 



(46) 



Then, we get 



J{u)<J {v) , V-y e W. 
Conversely, let u be a strict control minimizing the cost J over hi. Then 

J{u)<J {v) , V-y e W. 

Since the controls u, w G W, then there exist fi,q (^ S (hi) such that 

fi = Su , q = 5v 

This implies that relations (45) hold. Consequently, we get 

J(m)< J(g), yqe5{U). 

The proof is completed. ■ 

4.1 Necessary optimality conditions for strict controls 

Define the Hamiltonian H in the strict case from [0, T] x M" x Mn-Kd (K) x R" x ?7 
into M by 

Hit,y,z,p,v) ^pb{t,y,z,v) - h{t,y,z,v). 
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Theorem 18 (Necessary optimality conditions for strict controls) Let u be an 
optimal control minimizing the functional J overU and {y",Zf) the solution of 
(1) associated with u. Then there an unique adapted process p, solution of 

dp^ = Hy (t, y", z^, ut,p^) dt + H, (t, y^, z^ , Ut,p^) dWt, , . 

Such that 

H{t,y^,z]^,ut,p'^)>H{t,y]^,z^,vt,p'^);yvteU; ae , as. (48) 

Proof. Let u be an optimal solution of the strict control problem {(1) , (2) , (3)}. 
Then, there exist /x S (5 {U) such that 

/x = 6u- 

Since u minimizes the cost J over U, then by lemma 15, fi minimizes J over 
TZ. Hence, by the necessary optimality conditions for relaxed controls (Theorem 
10), there exist an unique adapted process p'^, solution of (25), such that 

H{t,y^,z^,^it,p'^)>n{t,y^,z^,qt,p'^), Vg, eP(;7), a.e, a.s. (49) 

Since S{U) (lP{U), then we get 

'^{t,yt,4,l^t,Pt)>T-(-{t,y^,z^,qt,p'^), yqteS{U), a.e, a.s. (50) 

Since q E 5 (lA), then there exist v E U such that q — Sy. 

We note that v is an arbitrary element of U since q is arbitrary. 

Now, since /j, = Su and q = S^, we can easily see that 

(y^;^^) = (2/^z"), 
(y«,z«) = (2/^z"), 

p^^p^, (51) 

n{t,yi;,z^,Ht,P^)^H{t,yf,zl^,Ut,pf), 
[ n{t,y>;,z^,qup'^)^Hit,yr,zr,VuPlt), 

where p" is the unique solutions of (46). 

By using (49) and (50), we can easy deduce (47). The proof is completed. 



4.2 Sufficient optimality conditions for strict controls 

We recall assumptions (4) an the adjoint equation (46). 

Theorem 19 (Sufficient optimality conditions for strict controls) Assume that 
g is convex and the function (j/, z) i — > H (t, y, z, q,p) is concave. Then, u is an 
optimal solution of the control problem {(1) , (2) , (3)}, if it satisfies (47) . 
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Proof. Let u be a strict control (candidate to be optimal) such that necessary 
optiniality conditions for strict controls hold. That is 

H{t,y^,z't.UuPt)>H{t,y'^,z^,VuPr).yvt^U, a.e, a.s. (52) 

The controls u, v are elements of U, then there exist fj,,q E S (14) such that 

fi = Su , q = 5v 

This implies that relations (50) hold, then by (51), we deduce that 

^^{t,yt,4^^^t,Pt)>^^{t,yt,4lQt,Pt), V(7te(5(c/), a.e, a.s. 

Since H is concave in {y, z), it is easy to see that Ti is concave in (y, z), and 
since g is convex, then by the same proof that in theorem 11, we show that fi 
minimizes the cost J over 6 (U). 

Finally by lemma 16, we deduce that u minimizes the cost J over U. The 
proof is completed. ■ 

Remark 20 The sufficient optimality conditions for strict controls are proved 
without assuming neither the convexity ofU nor that of H in v. 
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